Mixed Scale Motion Recovery Using Guidable Cameras

Captured human motion is widely used by the medical, surveillance, and entertainment industries. In these fields, many interesting motions occur at mixed scales. Subtle localized motion often occurs together with long range movements. One of the chief challenges in recovering these motions is to obtain high resolution imagery suitable for resolving small details, while simultaneously increasing the working volume in which recovery is possible. This paper proposes an architecture for mixed scale motion recovery. Robust coverage of a large working volume is provided by a wide area tracking system. This system localizes interesting motions, and guides a separate foveated system of pan-tilt cameras to observe the detailed motion at high resolution. We demonstrate two applications, foveated structured light scanning and the capture of muscle deformation while walking. Both applications allow recovery of subtle detailed motion that would not be possible using existing single scale systems.